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Abstract 

Objective To investigate the planning of subgroup analyses in protocols 
of randomised controlled trials and the agreement with corresponding 
full journal publications. 

Design Cohort of protocols of randomised controlled trial and subsequent 
full journal publications. 

Setting Six research ethics committees in Switzerland, Germany, and 
Canada. 

Data sources 894 protocols of randomised controlled trial involving 
patients approved by participating research ethics committees between 
2000 and 2003 and 515 subsequent full journal publications. 

Results Of 894 protocols of randomised controlled trials, 252 (28.2%) 
included one or more planned subgroup analyses. Of those, 17 (6.7%) 
provided a clear hypothesis for at least one subgroup analysis, 1 0 (4.0%) 
anticipated the direction of a subgroup effect, and 87 (34.5%) planned 
a statistical test for interaction. Industry sponsored trials more often 
planned subgroup analyses compared with investigator sponsored trials 
(195/551 (35.4%) 1-57/343(16.6%), P<0.001). Of 515 identified journal 
publications, 246 (47.8%) reported at least one subgroup analysis. In 
81 (32.9%) of the 246 publications reporting subgroup analyses, authors 
stated that subgroup analyses were prespecified, but this was not 
supported by 28 (34.6%) corresponding protocols. In 86 publications, 
authors claimed a subgroup effect, but only 36 (41 .9%) corresponding 
protocols reported a planned subgroup analysis. 

Conclusions Subgroup analyses are insufficiently described in the 
protocols of randomised controlled trials submitted to research ethics 
committees, and investigators rarely specify the anticipated direction of 
subgroup effects. More than one third of statements in publications of 
randomised controlled trials about subgroup prespecification had no 
documentation in the corresponding protocols. Definitive judgments 
regarding credibility of claimed subgroup effects are not possible without 
access to protocols and analysis plans of randomised controlled trials. 

Introduction 

The primary goal of a randomised controlled trial is to determine 
the benefits and harms of an intervention. However, trial 
populations are typically heterogeneous for individual patient 



characteristics such as age, sex, disease severity, or comorbidity. 
The question therefore arises as to whether effects of an 
intervention vary across these patient characteristics. 
Randomised controlled trials commonly report exploration of 
such possible subgroup effects'"'^ and, if conducted appropriately, 
such exploration can lead to more targeted chnical 
recommendations, better informed clinical decision making, 
and improved patient care.'' ^ More often, their results are 
misleading and can have detrimental consequences." ' 

Because subgroup analyses may be either informative or 
misleading, healthcare providers and policymakers need criteria 
to differentiate credible from spurious subgroup effects." 

Chnical epidemiologists have suggested criteria" ' " that allow 
readers to gauge the likelihood that a subgroup effect is real, on 
a continuum from highly plausible to extremely unlikely.'"^ All 
available criteria include the prespecification of subgroup 
analyses; some additionally include the anticipated direction of 
the subgroup effect and the use of a statistical test tackling the 
likelihood that apparent subgroup effects may be explained by 
chance."'"-" 

Judging the credibility of a reported subgroup effect relies on 
the information provided in published articles, because trial 
protocols are usually not freely accessible. Little is known about 
the planning of subgroup analyses in trial protocols and the 
extent to which they are reported in subsequent publications, 
and, in particular, which claims of prespecification correspond 
to these descriptions." " Pioneer work by Chan and colleagues" 
suggested large discrepancies between protocols and 
publications, but their sample was limited to 70 protocols of 
randomised controlled trials from a single centre. 

We investigated subgroup planning and reporting based on 
protocols of randomised controlled trials from six international 
centres and the corresponding publications. We focused 
specifically on the agreement between statements about 
subgroup prespecification in the publication and corresponding 
statements in the protocols. 
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Methods 
Study design 

We used protocols of randomised controlled trials and 
corresponding publications included in a retrospective cohort 
study; the rationale and design have been described elsewhere." 
In short, the study examined protocols approved between 2000 
and 2003 by six research ethics committees in Switzerland 
(Basel, Lucerne, Zurich, and Lausanne), Germany (Freiburg), 
and Canada (Hamilton). We focused on protocols that had been 
approved 10 or more years ago to ensure that the number of 
ongoing randomised controlled trials would be limited."* 

Eligibility criteria for protocols and 
subsequent publications 

In the present study, we included protocols regardless of 
publication status. We excluded those of trials that compared 
different doses or routes of administering the same drug (early 
dose finding studies), enrolled only healthy volunteers, were 
never started, or were still ongoing as of April 2013. We 
included only full (peer reviewed) journal publications from 
corresponding protocols of randomised controlled trials; we 
excluded research letters, letters to the editor, or conference 
abstracts. 

Definitions 

We defined a subgroup as a subset of all trial participants with 
distinct characteristics at randomisation (for example, age, sex, 
stage of disease). We defined a subgroup analysis as an analysis 
that explored whether intervention effects (experimental versus 
control) differed according to these characteristics. For 
protocols, we considered a subgroup analysis as planned if at 
least one of the following was reported: any statement in the 
protocol analogous to the definition above (for example, 
"intervention effects will be investigated according to patient 
baseline characteristics"); a stratified analysis (for example, 
"patients will be stratified according to sex and analysed 
separately"); a test for interaction (that is, interaction between 
intervention and patient characteristic); or an investigation of 
effect modifying factors. For publications, we considered a 
subgroup analysis as reported if the article included at least one 
of the following: an effect estimate and an associated confidence 
interval or a P value for one or more subgroups; a difference 
between effect estimates of different patient subgroups; 
investigation of potential effect modifiers, or the results from 
a test for interaction; or an explicit statement that a subgroup 
analysis had been undertaken. We assessed protocols for 
industry sponsorship or investigator sponsorship using the 
following criteria: the protocol clearly named the sponsor, 
displayed a company or institution logo prominently, mentioned 
affihations of authors of the protocol, included statements about 
data ownership or publication rights, or included statements 
about full funding by industry or public funding agencies."* 

Data extraction process and search for 
publications 

Twelve investigators trained in clinical research methodology 
independently extracted data from eligible trial protocols and 
correspondence between the research ethics committees and the 
local investigators. Thirty per cent of the extractions were done 
in duplicate as an initial calibration process to maximise the 
consistency of data extraction across reviewers. If the files of 
the ethics committee provided no information about the 
publication status of a trial, we conducted comprehensive 



searches of electronic databases to find any associated 
publications; previous publications present details of the 
searches and data extraction process." "* When randomised 
controlled trials that mentioned any prespecified subgroup 
analyses in their publications did not mention any subgroup 
analyses in corresponding protocols, we searched for additional 
versions of the protocol published in journals, any available 
analysis plans (from journals, filed documents at research ethics 
committees, or websites), and information published in trial 
registries (clinicaltrials.gov, WHO International Clinical Trials 
Registry Platform). Twenty two investigators trained in clinical 
research methodology extracted data from all corresponding 
publications, independently and in duplicate; disagreements 
were resolved by consensus or by third party adjudication. 
Protocols and corresponding publications were not extracted 
by the same person. 

Information collected about subgroup 
analyses 

We recorded the number of subgroup analyses planned in 
protocols and reported in publications. We asked the several 
questions, guided by criteria for the credibility of subgroup 
analyses." For protocols: any subgroup analyses mentioned? If 
yes: Any clear hypothesis for the planned subgroup analyses 
mentioned? Any anticipated direction of a subgroup effect 
mentioned? Any test for interaction mentioned? How many 
subgroup analyses were planned? 

For publications: does the publication report any subgroup 
analysis? If yes: Does the publication report that subgroup 
analyses were prespecified? Does the publication report that 
subgroup analyses were done post hoc? Does the publication 
provide a rationale for any subgroup analysis? Does the 
publication report an anticipated direction of any subgroup 
effect? Does the publication report any separate power 
calculation for subgroup analyses? Does the publication report 
any test for interaction? How many subgroup analyses are 
reported? Does the publication report any claim about a 
subgroup effect? We considered a subgroup effect as claimed 
if the investigators explicitly stated in the abstract or 
discussion/conclusion that the effect of an intervention was 
different between subgroups or a clear benefit or harm was seen 
in one or more subgroups. 

Statistical analysis 

For binary data we summarised results as frequencies and 
proportions and for continuous data as medians and interquartile 
ranges. We considered three analysis sets: a dataset based on 
all protocols (protocol set), a dataset based on corresponding 
publications (publication set), and a dataset of publications and 
matched corresponding protocols (publication-protocol set). 
We prespecified stratification of our descriptive analyses by 
sponsorship and hypothesised, based on results reported by Sun 
and colleagues, that industry sponsored trials more often planned 
subgroup analyses. ' We examined the difference between these 
proportions using the %' test. We used the statistical programmes 
R version 2.15.3 (www.r-project.org) and STATA version 13.0 
(Stata, College Station, TX, USA) for our analyses. 

Results 

Planning of subgroup analyses — ^the protocol 
set 

Of 894 eligible protocols of randomised controlled trials 
involving patients (figureJi), 252 (28.2%) planned at least one 
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subgroup analysis. Those trials planning subgroup analysis had 
on average a larger sample size, were more often multicentre 
trials, and were from the specialty of cardiovascular medicine 
(table IJJ). Industry sponsored trials more often planned 
subgroup analyses than investigator sponsored trials (195/551 
(35.4%) V 57/343 (16.6%), P <0.001). Of the 252 protocols 
planning at least one subgroup analysis, 17 (6.7%) provided a 
hypothesis and 10 (4.0%) provided an anticipated direction of 
a potential subgroup effect (table 2li). 

Reporting of subgroup analyses — the 
publication set 

For 515 protocols we identified corresponding full journal 
publications (publication set, figure). Of those, 246 (47.8%) 
publications reported subgroup analyses. These trials were, on 
average, larger and more often published in high impact journals 
than published randomised controlled trials without subgroup 
reporting (see supplementary table 1). Table 311 summarises the 
reporting of subgroup credibility criteria and characteristics of 
subgroup analyses in these full journal publications. Similar to 
the protocol set, subgroup hypotheses or anticipated directions 
of subgroup effects were rarely provided. Of 86 publications 
claiming a subgroup effect, 39 (45.3%) reported the use of an 
interaction test, 9 (10.5%) provided a subgroup hypothesis, and 
5 (5.8%) provided an anticipated direction of effect. 

Agreement between subgroup reporting in 
publications and corresponding 
protocols — the publication-protocol set 

Of 5 15 publications of randomised controlled trials, 132 (25.6%) 
reported the conduct of subgroup analyses that were not 
mentioned in the corresponding protocols; 64 (12.4%) 
publications did not report subgroup analyses that were planned 
in the corresponding protocols. 

Of those 246 publications that reported subgroup analyses, 
overall 114 (46.3%) corresponding protocols planned at least 
one subgroup analysis (for industry sponsored trials 86/160 
(53.8%), for investigator sponsored trials 28/86 (32.6%)). In 
those 1 14 trials, the reported number of subgroup analyses 
matched the planned number in the protocol in 1 1 (9.6%) 
instances. Table 4 ;,[ summarises the agreements of subgroup 
credibility criteria for those 246 trials reporting at least one 
subgroup analysis. In 81 of 246 (32.9%) publications reporting 
subgroups, authors stated for at least one of their reported 
subgroup analyses that it was prespecified, but 28 (34.6%) 
corresponding protocols had not mentioned any planned 
subgroup analysis. For 12 of these 28 randomised controlled 
trials, the authors mentioned a separate analysis plan in the 
publication or the protocol without mentioning subgroup 
analyses. However, these analysis plans were not made available 
to readers. We found registered information for 9 (32.1%) of 
the 28 randomised controlled trials but without any evidence 
of planned subgroup analyses. Of the 86 publications claiming 
a subgroup effect, 36 (41 .8%) corresponding protocols reported 
a planned subgroup analysis. 

Discussion 

Our study provides empirical evidence documenting the 
planning and reporting of subgroup analyses in a sample of 894 
randomised controlled trials involving patients, which were 
approved by six research ethics committees in three countries. 
About half of the published trials reported the conduct of 
subgroup analyses, of which only 46% had mentioned any 
planned subgroup analyses in the corresponding protocols. 



Industry sponsored randomised controlled trials planned 
subgroup analyses more often than investigator sponsored trials, 
but still only half of industry sponsored trials reporting results 
for subgroups explicitly stated such planned analyses in the 
protocol. In trials with subgroup analyses mentioned in both 
the protocol and the publication, the number of subgroup 
analyses reported in publications matched the number in 
protocols in only 10%. Investigators rarely provided a rationale 
for or indicated the anticipated direction of potential subgroup 
effects in either protocols or reports of randomised controlled 
trials. Of the journal publications stating that at least one 
subgroup analysis was preplanned, a third failed to mention any 
subgroup analysis in the corresponding protocol. 

Strengths and limitations of this study 

The data for the present study were collected as part of a large 
international cohort involving six research ethics committees 
that allowed full access to trial protocols and filed 
correspondence.'^ "* As outlined previously,"" unrestricted access 
is absolutely necessary (but not always granted) to maintain 
scientific rigor: asking trialists and sponsors for permission to 
access their protocols would very likely introduce bias, because 
those with substandard reporting practices may be less likely 
to allow additional scrutiny. As further strengths we involved 
only trained methodologists in data abstraction and performed 
all data extractions from identified publications independently 
and in duplicate. Finally, our sample included randomised 
controlled trials from various disciplines of clinical medicine, 
thus enhancing generalisability of our results. 

Our study has limitations. Firstly, we did not have access to 
statistical analysis plans that may have had prespecified 
subgroup analyses not mentioned in the protocol. However, we 
exhaustively checked all available evidence (published 
protocols, trial websites, filed documents at research ethics 
committees, trial registries) for prespecification of subgroup 
analyses. Nevertheless, our results fail to take into account 
changes in the protocol that occurred before examination of the 
data and that were not recorded in any of the above documents. 
Secondly, we did not systematically extract information from 
protocols about separate power calculations for subgroup 
analysis. However, since only 4% of protocols that planned 
subgroup analysis provided an anticipated direction of a 
subgroup effect, appropriate power calculations (additionally 
including an estimate for the magnitude of the subgroup effect) 
were likely to be even less common. Only 2.4% of publications 
that mentioned a subgroup analysis reported a corresponding 
power calculation. Thirdly, we used a convenience sample of 
six research ethics committees, which were, to our knowledge, 
not in any way particular. Still, we cannot say whether they are 
representative of other research ethics committees in their own 
or other countries. Fourthly, owing to limited resources we used 
single data extraction for 70% of protocols, thereby potentially 
increasing errors in extraction. However, we used pre-piloted 
extraction forms with detailed written instructions, conducted 
formal calibration exercises with all data extractors, and checked 
extractions from a random sample of protocols at several points 
during the process. Agreement was good, with no more than 
two discrepancies in 30 extracted key variables."* Fifthly, instead 
of a formal protocol for the current substudy, we previously 
published a protocol only of the overall project, mentioning this 
study without details." Therefore we limited hypothesis testing 
in this study to one prespecified subgroup analysis and we make 
our data extraction forms reflecting all collected variables 
available to readers on request. Sixthly, included protocols were 
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approved 10-13 years ago; the planning of subgroup analyses 
in protocols may have improved since that time. 

Comparison with other studies 

In an earlier systematic review of 469 randomised controlled 
trials" we found that 44% of full text publications reported 
subgroup analyses, which is consistent with our present finding 
of 48%. In the previous study, we found that most claimed 
subgroup effects in randomised controlled trials had low 
credibility and prespecification was seldom reported. The present 
study not only confirms this finding, but reveals that, often, the 
claim of prespecification of subgroups in publications is not 
supported by the corresponding protocols. 

Many previous empirical studies mentioned that justification 
of subgroup analysis and the statistical methods used were rarely 
reported.'"^ " ~' Of those, only some smaller studies compared 
grant applications"" or protocols of randomised controlled 
trials" " with publications for information about subgroup 
analyses and identified considerable discrepancies: Boonacker 
and colleagues noted that only 11 of 47 (23%) grant proposals 
for randomised controlled trials were in agreement with 
publications""; Chan and colleagues found that 25 of 70 (36%) 
randomised controlled trials reported subgroup analyses in the 
protocol or in the publication and that there were discrepancies 
between the two documents for all 25 randomised controlled 
trials"'; and Al-Marzouki and colleagues documented that only 
8 of 19 (42%) protocols of randomised controlled trials not 
mentioning subgroup analyses and 7 of 18 (39%) protocols 
planning subgroup analyses were consistent with corresponding 
publications." In our sample, numbers of subgroup analyses in 
protocols and publications were identical in less than 5% 
(11/246) of randomised controlled trials reporting subgroups. 
Only Chan and colleagues examined whether reported 
prespecification of subgroup analyses in publications (7/20, 
35%) was supported by planned subgroup analyses in protocols. 
Four of 7 (57%) randomised controlled trials with reported 
prespecifications lacked evidence of prespecification in the 
corresponding protocols."" 

Implications for reporting and interpreting 
subgroup analyses 

Current recommendations aim to help readers when judging the 
credibility of subgroup analyses based on information provided 
in the pubUcation.' " Empirical evidence from comparisons of 
protocols of randomised controlled trials and publications has 
been limited." Our results challenge a key criterion of all 
previous recommendations — that is, the a priori specification 
of the subgroup analysis. Given that in one out of three studies' 
protocols do not corroborate reported claims of prespecification 
of subgroup analyses, gains in credibility from this criterion are 
limited. 

The following steps could help to improve the trustworthiness 
of reported subgroup analyses. Firstly, planned subgroup 
analyses should be documented in trial registries. To date, 
however, possibilities to enter such information in trial registries 
are insufficiently developed. For example, there is a 
non-mandatory "Group/Cohort" field in the registry 
clinicaltrials.gov that could be used for subgroup 
prespecification, but the corresponding data element description 
remains unclear."' The WHO International Chnical Trials 
Registry platform"^ and the registry Controlled Clinical Trials^^ 
currently do not enable entry of information about subgroups. 
Secondly, clinical investigators should adhere to guidelines for 
protocols of randomised controlled trials such as the SPIRIT 



statement.^' "^ Research ethics committees and other review 
boards should promote the use of such guidance documents. 

Thirdly, journals should request access to protocols or statistical 
analysis plans for their review process and make these 
documents accessible to readers. In addition, journals could 
enforce adherence to guidelines for the reporting of randomised 
controlled trials (for example, the CONSORT statement)'" to 
reduce the prevalent incomplete reporting of subgroup analyses. 
Unless a reliable source such as a comprehensive trial protocol 
is available, readers of trial reports should consider statements 
about subgroup prespecifications with scepticism. When judging 
the credibility of a subgroup effect, readers may look for similar 
studies instead and consider whether subgroup findings are 
consistent. 

Conclusion 

Large discrepancies exist between the planning and reporting 
of subgroup analyses in randomised controlled trials. Published 
statements about subgroup prespecification were not supported 
by study protocols in about a third of cases. Our results highlight 
the importance of enhancing the completeness and accuracy of 
protocols of randomised controlled trials and their accessibility 
to journal editors, reviewers, and readers. 
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What is already known on this topic 

Claims of subgroup effects in randomised trials have little credibility 

Prespecification of subgroup analyses is an important criterion to assess ttie credibility of subgroup effects in randomised trials 
What this study adds 

Large discrepancies exist between planning of subgroup analyses in protocols and their reporting in publications of randomised trials 

Statements about subgroup prespecification in journal publications are of low credibility if access to trial protocols and analysis plans 
are not provided 

Protocol and registry information of randomised trials should include a statement whether subgroup analyses are planned or not, and 
if so, should specify them 
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Tables 



Table I Trial characteristics based on protocols. Values are numbers (percentages) unless stated otherwise 





Subgroup analyses 




Characteristics 


Trials did not plan (n: 


=642) Trials did plan (n=252) 


All trials (n=8g4) 


Median (interquartile range) target sample size* 


200 (80-460) 


521 (229-1007) 


260 (100-606) 


Centre status: 


Multicentre 


500 (77.9) 


241 (95.6) 


741 (82.9) 


Single centre 


139 (21.7) 


10(4) 


149 (16.7) 


Unclear 


3 (0.5) 


1 (0.4) 


4 (0.4) 


Study design: 


Parallel 


592 (92.2) 


244 (96.8) 


836 (93.5) 


Crossover 


40 (6.2) 


1 (0.4) 


41 (4.6) 


Factorial 


9(1.4) 


6 (2.4) 


15(1.7) 


Unclear 


1 (0.2) 


1 (0.4) 


2 (0.2) 


Study intention: 


Superiority 


456 (71.0) 


196 (77.8) 


652 (72.9) 


Non-inferiority 


95 (14.8) 


44 (17.5) 


139 (15.5) 


Unclear 


91 (14.2) 


12 (4.8) 


103 (11.5) 


Unit of randomisation: 


Individuals 


629 (98.0) 


250 (99.2) 


879 (98.3) 


Clusters 


10 (1.6) 


2 (0.8) 


12 (1.3) 


Body parts 


3 (0.5) 


0 (0.0) 


3 (0.3) 


Sponsorship: 


Investigator 


286 (44.5) 


57 (22.6) 


343 (39.8) 


Industry 


356 (55.5) 


195 (77.4) 


551 (60.2) 


Clinical discipline: 


Oncology 


113 (17.6) 


42 (16.7) 


155 (17.3) 


Cardiovascular 


59 (9.2) 


49 (19.4) 


108 (12.1) 


infectious disease 


60 (9.3) 


27 (10.7) 


87 (9.7) 


Endocrinology 


47 (7.3) 


15 (6.0) 


62 (6.9) 


Neurology 


37 (5.8) 


24 (9.5) 


61 (6.8) 


Other 


326 (50.8) 


95 (37.7) 


421 (47.1) 


'Information missing in 12 protocols. 
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Table I Subgroup credibility criteria based on trial protocols that planned at least one subgroup analysis. Values are numbers (percentages) 
unless stated otherwise 





Sponsorship 




Credibility criteria 


Industry (n=195) Investigator (n=57) 


All trials (n=252) 


Clear hypothesis given?: 


Yes 


7 (3.6) 


10 (17.5) 


17(6.7) 


No 


188 (96.4) 


47 (82.5) 


235 (93.3) 


Direction of anticipated effect given?: 


Yes 


3(1.5) 


7 (12.3) 


10 (4.0) 


No 


192 (98.5) 


50 (87.7) 


242 (96.0) 


Interaction test planned?: 


Yes 


69 (35.4) 


18 (31.6) 


87 (34.5) 


No 


126 (64.6) 


39 (68.4) 


165 (65.5) 


No of planned subgroup analyses: 


Median (interquartile range) 


3(1,6) 


3(1,6) 


3(1,4) 


Not reported (No of studies) 


18 (9.2) 


12 (21.1) 


30 (11.9) 
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Table : | Reported subgroup credibility criteria and interpretation of subgroup analyses based on publications that reported at least one 
subgroup analysis. Values are numbers (percentages) unless stated otherwise 





Sponsorship 




Reported credibility criteria and interpretation 


Industry (n=160) Investigator (n=86) 


All trials (n=246) 


Prespecification of subgroup analyses reported in publication?: 


Yes 


58 (36.2) 


23 (26.7) 


81 (32.9) 


No 


102 (63.7) 


63 (73.3) 


165 (67.1) 


Post fioc subgroup analyses reported in publication?: 


Yes 


27 (16.9) 


21 (24.4) 


48 (19.5) 


No 


133 (83.1) 


65 (75.6) 


198 (80.5) 


Clear hypothesis given?: 


Yes 


11 (6.9) 


10 (11.6) 


21 (8.5) 


No 


149 (93.1) 


76 (88.4) 


225 (91.5) 


Direction of anticipated effect given?: 


Yes 


5(3.1) 


6 (7.0) 


1 1 (4.5) 


No 


155 (96.9) 


80 (93.0) 


235 (95.5) 


Power calculation for subgroup analyses mentioned in publication?: 


Yes 


3(1.9) 


3 (3.5) 


6 (2.4) 


No 


157 (98.1) 


83 (96.5) 


240 (97.6) 


Test for interaction reported?: 


Yes 


60 (37.5) 


36 (41.9) 


96 (39.0) 


No 


100 (62.5) 


50 (58.1) 


150 (61.0) 


No of reported subgroup analyses: 


Median (interquartile range) 


4(1,8) 


4 (2, 8) 


4 (2, 8) 


Not reported 


6 (3.8) 


2(1.3) 


8 (3.3) 


Any claim of subgroup effect reported?: 


Yes 


57 (35.6) 


29 (33.7) 


86 (35.0) 


No 


103 (64.4) 


57 (66.3) 


160 (65.0) 
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Table ^| Agreement of planning and reporting of subgroup credibility criteria based on those 246 publications reporting at least one 
subgroup analysis. Numbers are protocols/publications reporting or not reporting subgroup credibility criteria (percentages) 



Planned In protocol 






Reported In publication 






Industry sponsorship (n=160) Investigator sponsorship (n=8£ 


i) All trials (n=246) 


Subgroup hypothesis: 


No 


Yes 


No 


Yes 


No Yes 


No 


143 (89.4) 


11 (6.9) 


73 (84.9) 


8 (9.3) 


216(87.8) 19(7.7) 


Yes 


6 (3.8) 


0 (0.0) 


3 (3.5) 


2 (2.3) 


9 (3.7) 2 (0.8) 


Direction of effect: 


No 


153 (95.6) 


5(3.1) 


78 (90.7) 


4 (4.7) 


231 (94.0) 9 (3.7) 


Yes 


2(1.3) 


0 (0.0) 


2 (2.3) 


2 (2.3) 


4(1.6) 2(0.8) 


Interaction test: 


No 


80 (50.0) 


46 (28.8) 


48 (55.8) 


26 (30.2) 


128 (52.0) 72 (29.3) 


Yes 


20 (12.5) 


14 (8.8) 


2 (2.3) 


10 (11.6) 


22 (8.9) 24 (9.8) 
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Figure 



Protocols screened (n=3819): 

Hamilton (Canada) (n=984) Lausanne (Switzerland) (n=692) 
Basel (Switzerland) (n=931) Zurich* (Switzerland) (n=160) 
Freiburg (Germany) (n=917) Lucerne (Switzerland) (n=135) 

I — ^ No randomised controlled trial design (n=2411) 

Protocols reviewed in detail (n=1408) 

Excluded (n=328): 
Protocol duplicates (n=192) 
— ^ No complete protocol available (n=87) 

No research ethics committee approval (n=41) 
No randomised controlled trial design (n=8) 

Approved randomised controlled trial protocols (n=1080) 

Excluded (n=63): 
— " Randomised controlled trials never started (n=53) 
Randomised controlled trials still going (n=10) 

Randomised controlled trial protocols (n=1017) 

Randomised controlled trials only 
enrolling healthy volunteers (n=123) 

Randomised controlled trial protocols enrolling 
patients included (protocol set) (n=894) 



Planned subgroup 
analyses (n=252) 




Did not plan subgroup 
analyses (n=642) 







Excluded (n=379): 

Randomised controlled trials not published (n=325) 
Randomised controlled trials published as abstract 
~^ (n=39) 

No randomised controlled trial results publishedt (n=9) 
Randomised controlled trials published as letter (n=6) 

Full journal publications considered for 
reporting analyses (publication set) (n=515) 



Reported subgroup Did not report subgroup 

analyses (n=246) analyses (n=269) 



Study flow of protocols of randomised controlled trials and publications. *Only protocols from two subsidiary research ethics 
committees responsible for paediatric and surgical randomised controlled trials were screened. fNo results from randomised 
comparison published 
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